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Abstract. We present an algorithm for decomposing a symmetric tensor, of dimension n and order d as a 
sum of rank-1 symmetric tensors, extending the algorithm of Sylvester devised in 1886 for binary forms. 

We recall the correspondence between the decomposition of a homogeneous polynomial in n variables of 
total degree d as a sum of powers of linear forms (Waring's problem), incidence properties on secant varieties 
of the Veronese Variety and the representation of linear forms as a linear combination of evaluations at 
distinct points. Then we reformulate Sylvester's approach from the dual point of view. 

Exploiting this duality, we propose necessary and sufficient conditions for the existence of such a decompo- 
sition of a given rank, using the properties of Hankel (and quasi-Hankcl) matrices, derived from multivariate 
polynomials and normal form computations. This leads to the resolution of polynomial equations of small 
degree in non-generic cases. 

We propose a new algorithm for symmetric tensor decomposition, based on this characterization and on 
linear algebra computations with these Hankel matrices. 

The impact of this contribution is two-fold. First it permits an efficient computation of the decomposition 
of any tensor of sub-generic rank, as opposed to widely used iterative algorithms with unproved global 
convergence (e.g. Alternate Least Squares or gradient descents). Second, it gives tools for understanding 
uniqueness conditions, and for detecting the rank. 

Contents 

1 . Introduction 2 

1.1. The binary case 3 

1.2. Notation and preliminaries 3 

2. Problem formulations 4 

2.1. Polynomial decomposition 4 

2.2. Veronese and Secant Varieties 5 

2.3. Decomposition using duality 5 

3. Hankel operators and quotient algebra 6 

4. Truncated Hankel operators 8 

5. Symmetric tensor decomposition algorithm 11 

5.1. First Example 11 

5.2. Second Example 13 

6. Conclusions and future work 16 
Acknowledgments. 16 
References 16 
Appendix A. Ternary cubics IS 
Appendix B. An example of extreme rank LLS 



l 



1. Introduction 



Symmetric tensors show up in applications mainly as high-order derivatives of multivariate functions. For 
instance in Statistics, cumulant tensors are derivatives of the second characteristic function 

Tensors have been widely utilized in Electrical Engineeringsince the nineties (Hlj . and in particular in 
Antenna Array Processing [§2] @ or Telecommunications [H3| [ll [HI 25 1 Even earlier in the seventies, 
tensors have been used in Chemometrics 0] or Psychometrics |33j . 

Arithmetic complexity is also an important field where the understanding of tensor decompositions has 
made a lot of progress, especially third order tensors, which represent bilinear maps [35| [|| [37l |. 

Another important application field is Data Analysis. For instance, Independent Component Analysis, 
originally introduced for symmetric tensors whose rank did not exceed dimension Q. Now, it has 



become possible to estimate more factors than the dimension [23[ [32j . In some applications^tensors may be 
symmetric only in some modes .14] , or may not be symmetric nor have equal dimensions [lj| [H|- Further 
numerous applications of tensor decompositions may be found in (lQ| j4t| . 



Note that in some cases, tensors are encountered in the form of a collection of symmetric matrices [21 1 
[54I [4^ [53|], in which case they may enjoy symmetries in some modes but not in others. Conversely, 
some algorithms treat symmetric tensors as a collection of symmetric matrix slices 55 1 57 1 (20j . 

The problem of decomposition of a symmetric tensor, that we consider in this paper, is a rank determinant 
problem which extends the Singular Value Decomposition (SVD) problem for symmetric matrices. This 
former method is an important tool in (numerical) linear algebra, which received at lot of attention and 
which is routinely used in many applications (27| . As exhibited above, the extension to general symmetric 
tensors also appears in many application domains. However, many issues either theoretical or algorithmic 
remains unsolved. Among solved problems, let us mention the determination of the minimal number of terms 
in the decomposition of a generic tensor [2J, which is stated there in terms of a dual interpolation problem. 
See 3l|, chap. 2] and section [2] for the link between these two points of view. Among open problems are 
the determination of the maximal rank of tensors of given degree and dimension, or the determination of 
the stratification of the set of symmetric tensors by the rank. See however [ll| for an answer in the binary 
case. For a detailed presentation of the symmetric tensor decomposition problem, from a projective algebraic 



geometric point of view, we refer to [3l|. The properties of so-called catalecticant matrices, related to the 



apolar duality induced by the symmetric tensor associated with homogeneous polynomials of a given degree, 
are extensively studied. 

In a disconnected way, probably because of language barrier, investigations of this problem in numerical 
analysis have been developed, inspired by the successful work on order 2 tensors, i.e. matrices. However, 
despite their obvious practical interest, numerical algorithms presently used in most scientific communities 
are suboptimal, in the sense that they either do not fully exploit symmetries [l[ , minimize different successive 
criteria sequentially [HI [13] , or are iterative and lack a guarantee of global convergence [3(| [3] . In addition, 
they often request the rank to be much smaller than generic. Among these popular methods, we refer to 
PARAFAC techniques heavily applied for solving an ill-posed problem. . . Indeed contrarily to the matrix 
case, the set of symmetric tensors of rank < r is not closed, and its closure has singularities corresponding 
to tensors of rank > r. This explains why iterative numerical methods encounter difficulties to compute a 
tensor decomposition. For more details on open problems on symmetric tensors, see [TBI ]. 

The goal of this paper is to describe a new algorithm able to decompose a symmetric tensor of arbitrary 
order and dimension into a sum of rank-one terms. The algorithm proposed in this paper is inspired from 
Sylvester's theorem [36|], and extends its principle to larger dimensions. Using apolar duality on polynomials, 
we show that the symmetric tensor decomposition problem reduces to the decomposition of a linear form 
as a linear combination of evaluations at distinct points. We give a necessary and sufficient condition for 
the existence of a decomposition of rank r, based on rank conditions of Hankel operators or commutation 
properties. Instead of working, degree by degree, as in [3l| . we consider affine situations in order to treat at 
the same time the various homogeneous components. In the binary case, the decomposition problem can be 
solved directly by computing ranks of catalecticant. In higher dimension, this not so simple. An extension 
step is required to find the decomposition. This leads to the resolution of a polynomial system of small 
degree, from which we deduce the decomposition by solving a simple eigenvalue problem, thanks to linear 
algebra manipulations. 



2 



The algorithm is not restricted to strictly sub-generic ranks as for the method proposed in [3l|[chap. 5]. 
In sub-generic cases, the decomposition is essentially unique (i.e. up to scale and permutation) when some 
rank conditions are satisfied. Our algorithm fully exploits this symmetry and provides a complete answer to 



the questions of uniqueness and computation, for any order [13 1. 

In the following section, we recall the method deduced from Sylvester's theorem to decompose a binary 
form. In section^ we give three equivalent formulations of the same problem, used and studied in different 
communities. In section[3l we develop the duality point of view, extending the notion of generalized additive 
decomposition, introduced in 3l|, to any dimension. Section U is devoted to the algebraic characterization 
of the extension property of linear forms, in terms of rank condition on multivariate Hankel operators, or on 
commutation properties. Finally in section [5l we describe the algorithm and give examples. 



1.1. The binary case. The present contribution is a generalization of Sylvester's algorithm devised to 
decompose homogeneous polynomials in two variables into a sum of powers of linear forms [H3 | 11 1. It is 
hence convenient to first recall the latter algorithm. 



Theorem 1.1 (Sylvester, 1886). A binary quantic p(xi , X2) 
of d th powers of r distinct linear forms in C as: 



Ed 
i=0 



d—i 



1 ^2 



can be written as a sum 



(i) 



if and only if (i) there exists a vector q of dimension r + 1, with components qi, such that 



(2) 



co 



Cd-r 



Cd-i c d 



q=0. 



„r-i 



admits r distinct roots, i.e. it can be written as 



and (ii) the polynomial q(x\,X2) = Yl^—p Qi 
q(x!,x 2 ) = YTj=i(0j x l ~ a * 3 x 2)- 

The proof of this theorem is constructive [13] [HI [H| and yields Algorithm ll.il Given a binary polynomial 
p(xx,X2) of degree d with coefficients at = (.) Cj, < i < d, define the Hankel matrix H[r] of dimensions 
d — r + lxr + 1 with entries H[r]ij — Q+j-2- Note that step [5] is a specialization only if the dimension of 
the right kernel is strictly larger than 1. 



1.2. Notation and preliminaries. Let IK be an algebraically closed field (e.g. K = C the field of complex 
numbers). For a vector space E, its associated projective space is denoted ¥(E). For v e E — {0} its class 
in P(E) is denoted v. Let F n be the projective space of the field K n . 

If a = (a%, . . . ,a n ) is a vector in N™, then |a| is the sum of its elements, i.e. |a| = X)"=a ai - We also 
use the greek letters a and (3 for vectors in N™. We denote by x Q the monomial x" 1 ■ ■ ■ x" n . For a set 
B = {61, . . . , b m }, we denote by (B), respectively (£?), the corresponding vector space, resp. ideal. 

Let R be the ring of polynomials K[xi, . . . ,x n ], while Rd will denote the ring of polynomials of (total) 
de gree at most d. The set {x a }| Q |<^ = {x^ 1 ■ ■ -x""} Ql ^ — ^a n <d represents the elements of the monomial 
basis of the vector space Rd and contains elements. Hereafter, the superscript h denotes the homoge- 

nization of a polynomial. We denote by Sd the vector space of homogeneous polynomials in n + 1 variables 
xo,x±, . . . ,x n . This is also the symmetric c?-th power S d (E) where E — (xq, ■ ■ ■ , x n ) . The dehomogenization 
of o polynomial f £ Sd with respect to the variable xo is denoted f a := f(l, x\, . . . , x n ). 

Duality is an important ingredient of our approach. For a comprehensive treatment of duality on multi- 
variate polynomials, we refer the reader to [44f. Hereafter, for a K- vector space E its dual E* = HoniK(i?, K) 
is the set of K-linear forms form E to IK. 

A basis of the dual space R* d , is the set of linear forms that compute the coefficients of a polynomial in 
the primal basis. It is denoted by {d Q }| Q |< d . 

We may identify R* with the (vector) space of formal power series, i.e. K[[d]] = K[[di, . . . ,d n ]]. Any 
element A S R* can be decomposed as A = X) a ^( xa )°- a - Typical elements of R* are the linear forms that 
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Algorithm 1.1: Binary form decomposition 



Input: A binary form p(xo, x\) of degree d. 

Output: A decomposition of p as p{x±,X2) = Xw=i \ kj( x ) w ith r minimal. 

(1) Initialize r = 

(2) Increment r <— r + 1 

(3) If the column rank of H [r] is full, then go to step [2] 

(4) Else compute a basis {kj., . . . , k/} of the right kernel of H [r]. 

(5) Specialization: 

• Take a generic vector q in the kernel, e.g. q = /i^kj 

• Compute the roots of the associated polynomial q(xi, X2) = X)f=o ° e x i x 2 ■ Denote them 
(/3,-,-aj), where |aj| 2 + |p>| 2 = 1. 

• If the roots are not distinct in P 2 , try another specialization. If distinct roots cannot be 
obtained, go to step[U 

• Else if q(x%, X2) admits r distinct roots then compute coefficients Xj, 1 < j < r, by solving the 
linear system below, where dj denotes ( .) cj 



af 


a* 




a 


a? _1 /3i ■ 
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(6) The decomposition is p(xx, X2) = Sj=i kj'( x ) j where kj(x) = (ay xi + j3j x-i). 



correspond to the evaluation at a point £ € K n : 

l f : i?^K 

The decomposition of 1^ in the basis {d a }i a i<<j is 1^ = C a d a - Such an evaluation form can be composed 
with differentiation. In fact, if 9{d\, . . . , d n ) is a differential polynomial, then 

l ( o6(d 1 ,...,d n ) : R^K 

p^e(d 1 ,...,d n )(p)((). 

The dual space R* has a natural structure of i?-module [24[ which is defined as follows: for all p € R, and 
for all A £ R* consider the linear operator 

p-kA : R^K 

q i-> A(pq). 



In particular, we have x% * d a = 



otherwise. 



2. Problem formulations 
In this section, we present three different formulations of the same problem, that we consider in this paper. 

2.1. Polynomial decomposition. A symmetric tensor [a,j j n ] of order d and dimension n can be asso- 
ciated with a homogeneous polynomial /(x) € S^: 

(3) /( x ) = a io,h, — dn^Q^l ' ' ' ^n" ■ 

jo+jH hi„=d 

Our goal is to compute a decomposition of / as a sum of d th powers of linear forms, i.e. 

r 

(4) /(x) = ^ A, (k h0 x + ki,ixi + ■■■ + h, n x n ) d = Ai ki(x) d + A 2 k 2 (x) d + • • • + A r k r (x) d , 



where A.; ^ 0, k^ ^ 0, and r is the smallest possible. This minimal r is called the rank of /. 

The direct approach to solve this decomposition problem, is the following. Consider the relation 



/(x) = V" (k ifi x + k it ixi H h k; - ; "' 



.1 , , 



where ^ 0. We assume that r, the rank, is known and the smallest possible. We consider the r(n + 1) 
coefficients kij of the linear forms as unknowns. We expand (symbolically) the right hand side of the relation. 
The two polynomials of the left and right hand sides are equal, thus by equating the coefficients of the same 
monomials we get a polynomial system in the coefficients ki t j. This is an over-constrained polynomial system 
of ( n J d ) equations and r(n + I) unknowns. The polynomials of the system are homogeneous of degree d and 
the magnitude of their coefficients is < ffj 1 ^^. This approach describes the problem of decomposition in a 
non-optimal way. ft introduces r! redundant solutions, since every permutation of the linear forms is also 
a solution. Another drawback of this approach is that the polynomials involved are of high degree, that is, 
d. The reader can compare this with the degree 2 polynomial system, described in Section 31 containing the 
polynomials that we have to solve in order to extend the matrix. 

In the following sections, we are going to describe a new method, which is much more efficient to solve 
this decomposition problem. 

2.2. Veronese and Secant Varieties. Let us recall the well-known correspondence between the symmetric 
outer product decomposition and secant varieties for symmetric tensors. The set of symmetric tensors or 
homogeneous polynomials of the form k(x) d = (k x + k%Xx + ■ ■ ■ + k n x n ) d for k = (ko, hi, ■ ■ ■ , k n ) G K n is 
a closed algebraic set. Scaling the vector k by a non-zero scalar A yields a homogeneous polynomial scaled 
by \ d . Thus, we can also consider this construction as a map k i— > k(x) d from the projective space P™^ 1 to 
the projective space of symmetric tensors: 

v : P(5i) -> F(S d ) 
k(x) h-> k(x) d . 

The image of v is called the Veronese variety V n d [HI IsBl- Following this point of view, a tensor is of rank 
I if it corresponds to a point on the Veronese variety. A tensor is of rank < r if it is a linear combination 
of r tensors of rank 1. In other words, it is in the linear space spanned by r points of the Veronese variety. 
The closure of the r— dimensional linear space spanned by r points of the Veronese variety V n ,d is called 
the (r — l)-secant variety of V n ,d and denoted 5 r_1 (V„^)- We refer the reader to [29|, |j56| for examples 
and general properties of these algebraic sets. In the non-symmetric case, the so-called Segre variety of the 
projective space of tensors is considered instead of the Veronese variety. It corresponds to the set of (possibly 
non-symmetric) tensors of rank 1. 

For any / £ Sd — {0}, the smallest r such that / G S r ~ 1 (V n .d) is called the typical rank or border rank of 
/@,[H[53|. 

2.3. Decomposition using duality. Let /, g G S d , where / = Y,\ a \=d /" x o° ' 1 1 x n" and 9 = J2\ a \=d 5^0° ' ' 
We define the apolar inner product on Sd, as 



(/) 9) = ^2 fa 9a [ 

\a\=d 



«0, • 



Using this non-degenerate inner product, we can associate an element of Sd with an element S^, through 
the following map: 

t : Sd — > S^ 
f ^A/, 

where the linear form A/ is defined as A/ : g i— > (f,g). A simple calculation shows that (/, k(x) d ) = /(k) 
so that under this duality it holds that r(k(x) d ) = l k G S^. Moreover, under r, the polynomial / = 

E|aM c " O x " G s * is ma PP° d to /* = E| Q |= d c a d a 6 Sj. 

The problem of decomposition of / can then be restated as follows: 



Given /* £ S"|, find the minimal number of non-zero vectors kj, . . . ,k r 6 K n+1 and non-zero 
scalars Ai , . . . , A r € K — {0} such that 

r 

By scaling ki and multiplying Ai by the inverse of the d th power of this scaling factor, we may assume that 
the first non-zero coordinate of k, is 1. 

Definition 2.1. We say that f* is an affine decomposition if for every ki in the decomposition, k, ; 7^ 0. 

By a generic change of coordinates, any decomposition of /* can be transformed into an affine decompo- 
sition. To any /* £ S%, we can associate an element in R* d , defined by A/ : p £ Rd f*{p h ), where p h is 
the homogenization in degree d of p. If /* admits an affine decomposition with k^o = 1 then we also have 
that Af coincides with the linear form 

r 

1=1 

up to degree d, where ki is the vector made of the last n coordinates of k,; . 

3. Hankel operators and quotient algebra 

In this section, we recall the algebraic tools we will need to describe and analyze our algorithm. 
For any A £ R*, we define the bilinear form Qa, such that 

Qa : R x R -> K 

(a, 6) i — ^ A(ab). 

The matrix of Qa in the monomial basis, of R is Qa = (A(x Q+ ^)) a p, where a, (3 £ N". 
For any A <E R*, we define the Hankel operator H\ from R to R* as 

H A : R^R* 

p I— > p-k A. 

The matrix of the linear operator Ha in the monomial basis, and in the dual basis, {d Q }, is Ha = 
(A(x Q+/3 )) Q where a, (3 £ N" . The following relates the Hankel operators with the bilinear forms. For all 
a.b £ R, thanks to the i?-module structure, it holds 

Q A (a, b) = A(ab) = a ■ A(b) = b ■ A(o) = H A (a)(b) = H A {b)(a). 

In what follows we will identify Ha and Qa- 

Definition 3.1. Given B — {bi, . . . , 6,.}, B' = {b[, . . . , b' r ,} C R we define 

H*' 3 ' : (B) {BT, 

as the restriction of Ha to the vector space (B) and inclusion of R* in (B'}* . Let H^' 5 = (A(bi f)j))i<Kr,Kj<r' • 
If B' = B, we also use the notation H A and H^. 

If B, B 1 are linearly independent, then U 3 ' B is the matrix of H 3 ' B in this basis {&i, . . . , b r } of (B) and 
the dual basis of B' in (B')* . The catalecticant matrices of [3l[ correspond to the case where B and B' are 
respectively the set of monomials of degree < k and < d — k (k = 0, . . . , d). 

From the definition of the Hankel operators, we can deduce that a polynomial p £ R belongs to the kernel 
of Ha if and only if p * A = 0, which in turn holds if and only if for all q £ R, A(pq) = 0. 

Proposition 3.2. Let I a be the kernel of Ha- Then, I a is an ideal of R. 

Proof. Let pi,p 2 £ I A - Then for all q £ R, A((pi + p 2 )q) = A(p 1 q) + A(p 2 q) = 0. Thus, pi + p 2 £ Ia- If 
p £ Ia arid p' £ R, then for all q £ R, it holds A(pp'q) = 0. Thus pp' £ I a and Ia is an ideal. □ 
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Let Aa = R/Ia be the quotient algebra of polynomials modulo the ideal Ia, which, as Proposition 
states is the kernel of H\. The rank of Ha is the dimension of A\ as a K- vector space. 

A quotient algebra A is Gorenstein if there exists a non-degenerate bilinear form Q on A, such that for 
all polynomials /, g, h G A it holds that Q(f, gh) = Q(fg, h) or equivalently if there exists Ae^l* such that 
(/, g) G A x A i— > A(/ g) is non-degenerate. Equivalently, A is Gorenstein iff A* is a free „4-module generated 
by one element A G A*: A* = A* A. See e.g. Q for more details. The set A* A is also called the inverse 
system generated by A [HI ]. 

Proposition 3.3. XTie dual space A\ of Aa, can be identified with the set D = {q* A \ q G R} and Aa is 

a Gorenstein algebra. 

Proof. Let D = {q * A; q G R} be the inverse system generated by A. By definition, 

D x = {peR \ VgGi?,?*A(p) = A( OT ) = 0}. 

Thus D x = Ia, which is the ideal of the kernel of Ha (Proposition 13 . 2|) . Since Aa* = ifc is the set of linear 
forms in R* which vanish on I a, we deduce that „4a* = I a = -D ±J ~ = D. 

As p-k A = implies p G I a or p = in ,4a, this shows that Aa* is free rank 1 ylA-niodule (generated by 
A). Thus .Aa is Gorenstein. □ 

Definition 3.4. For any B C R, let B+ = B U x x B U • • • U x n B and dB = B+ - B. 

Proposition 3.5. Assume that rank(i?A) — r < oo and let B = {6 l5 . . . , b r } C R such that H£ is invertible. 
Then bi, . . . ,b r is a basis of Aa- If 1 G (B) the ideal I a is generated by keriJ A 3+ . 

Proof. Let us first prove that {b\, . . . , b r } n Ia — {0}. Let p G . . . , b r ) PI Ia- Then p = ^2 i Pi bi with 
Pi G K and A(pbj) = 0. The second equation implies that Hf p = 0, where p = [pi, . . . ,p r ] 1 G K r . Since 
is invertible, this implies that p = and p = 0. 

As a consequence, we deduce that b± -k A, . . . , b r * A are linearly independent elements of i?*. This 
is so, because otherwise there exists m = [jui, . . . ,/i r ] T 7^ 0, such that * A) + ••• + // r (6 r * A) = 

(Hibi + ■ ■ • + fi r b r ) ★ A = 0. As {61, ... , b r } n Kernel(HA) = {0}, this yields a contradiction. 

Consequently, {6i*A, . . . , b r *A} span the image of Ha- For any p G i?, it holds that p*A = Mi (&i * A) 

for some fj,i, . . . , [i r G K. We deduce that p — J2l=i e ^A- This yields the decomposition R = B © Ia, 
and shows that b\ , . . . , b r is a basis of „4a ■ 

If f G (B), the ideal /a is generated by the relations Xjb k — Y^i=i Mi' e ^A- These are precisely in the 
kernel of + . □ 

Proposition 3.6. //rank(iJA) = r < 00, then Aa is of dimension r over K and t/iere exist Cij ■ ■ ■ , Cd G K n 
where d < r), and pi G K[c?i, . . . , d n ], such that 

d 

(5) A = Y / h,°Md) 

i=i 

Moreover the multiplicity of Q is the dimension of the vector space spanned the inverse system generated by 
lCi °Pi{9)- 

Proof. Since rank(HA) = r, the dimension of the vector space Aa is also r. Thus the number of zeros of the 
ideal Ia, say {£1, . . . ,£d} is at most r, viz. d < r. We can apply the structure Theorem 24|, Th. 7.34, p. 
185] in order to get the decomposition. □ 

In characteristic 0, the inverse system of 1^ °Pi(d) by pi is isomorphic to the vector space generated by 
Pi and its derivatives of any order with respect to the variables di. In general characteristic, we replace the 
derivatives by the product by the " inverse" of the variables 44 1 , [24| . 

Definition 3.7. For f G S , we call generalized decomposition of f* a decomposition such that f* = 
^2i =1 1^ opi(d) where the sum for i — 1, . . . , d of the dimensions of the vector spaces spanned by the inverse 
system generated by 1^ op,(9) is minimal. This minimal sum of dimensions is called the length of f . 

This definition extends the definition introduced in [31] for binary forms. The length of /* is the rank of 
the corresponding Hankel operator Ha- 
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Theorem 3.8. Let A G R* ■ A = X)i=i w ^ ^ 7^ " Ci distinct points ofK n , iff r&nkH\ = r and 

I A is a radical ideal. 

Proof. If A = Si=i"^'lCi> with. A, 7^ and Q distinct points of K". Let {ei,...,e r } be a family of 
interpolation polynomials at these points: ei(Q) = 1 if i = j and otherwise. Let 1^ be the ideal of 
polynomials which vanish at Ci, ■ ■ ■ , Cr- It is a radical ideal. We have clearly 1^ C I\. For any p£ /a, and 
j = 1, . . . , r, we have p* A(ei) = A(pe.;) = p(Ci) = 0, which proves that I a ~ 1^ is a radical ideal. As the 
quotient .Aa is generated by the interpolation polynomials e±,...,e r , Ha is of rank r. 

Conversely, if rank7?A = f, by Proposition 13.61 A = 53i=i -"-Ci Pi (9) with a polynomial of degree 0, since 
the multiplicity of Q is 1. This concludes the proof of the equivalence. □ 

In order to compute the zeroes of an ideal I\ when we know a basis of Aa, we exploit the properties of 
the operators of multiplication in ,4a: M a : Aa — > Aa, such that V& G ^A,M a (6) = a 6 and its transposed 
operator M* : .4 A — > _4 A , such that for V7 G .4 A , Mj(j) = 0*7. 

The following proposition expresses a similar result, based on the properties of the duality. 

Proposition 3.9. For any linear form A G R* such that rank Ha < 00 and any a G ,4a, we have 
(6) #„* A = M* o ff A 

Proof. By definition, Vp G i?, H ai ,A(p) — ap* A = a*(p*A) = Mj oH A (p). □ 

We have the following well-known theorem: 

Theorem 3.10. Assume that Aa is a finite dimensional vector space. Then A = Yli=i °Pi(d) f or G £ K" 
and Pi(d) G K[3i, . . . , <9 n ] and 

• </«e eigenvalues of the operators M a and Af* ; are given by {a(£i), . . . , a(Cr)}- 

• £/ie common eigenvectors of the operators (M*.)i<j< n are (up £0 scalar) 1^. 

Proof. [IE EEl □ 

Using the previous proposition, one can recover the points Q G K" by eigenvector computation as follows. 
Assume that B C R with |£>| = rank(i?A), then equation ^ and its transposition yield 



where IM a is the matrix of multiplication by a in the basis B of ^4a- By Theorem l3.101 the common solutions 
of the generalized eigenvalue problem 

(7) (H a * A - AH A )v = O 

for all a G R, yield the common eigenvectors H A v of M^, that is the evaluation 1^ at the roots. Therefore, 
these common eigenvectors H A v are up to a scalar, the vectors [61 (Ci), ■ ■ ■ , b r (Ci)] (* = 1; ■ ■ • > r )- Notice that 
it is sufficient to compute the common eigenvectors of (H^^a, Ha) for i = 1, . . . , n 

If A = y^—i Ajlfj (Ai 7^ 0), then the roots are simple, and one eigenvector computation is enough: for 
any a G R, M a is diagonalizable and the generalized eigenvectors H A v are, up to a scalar, the evaluation 
1^ at the roots. 

4. Truncated Hankel operators 

Coming back to our problem of symmetric tensor decomposition, / = X)|a|<<2 Ca (q) x " ^ ^ d a dniits an 
affine decomposition of rank r, iff A(x Q ) = c a for all \a\ < d where 

r 

A = ^A, l Ci , 

i=l 

for some distinct £i, ...,£»■ G ^™ an d some A^ G K — {0}. 
Then, by theorem 13.81 Ha is of rank r and I a is radical. 

Conversely, given Ha of rank r with I a radical which coincides up to degree d with A^, by proposition 
13.61 A = A, 1^ and / can be decomposed as a sum of r d t/l -powers of linear forms. 

The problem of decomposition of / can thus be reformulated as follows: 



Given f* E Rd* find the smallest r such that there exists A E R* which extends f* with Ha 

of rank r and La a radical ideal. 
In this section, we are going to characterize under which conditions /* can be extended to A £ R* with Ha 
is of rank r. 

We need the following technical property on the bases of Aa, that we will consider: 

Definition 4.1. Let B be a subset of monomials in R. We say that B is connected to 1 if Vm £ B either 
m = 1 or there exists i £ [1,ti] and m' £ B such that m — Xi m' . 

Let B C Rd be a set of monomials of degree < d, connected to 1. We consider the formal Hankel matrix 

with h a — /*(x Q ) = c a if \a\ < d and otherwise h a is a variable. The set of all these new variables is denoted 
h. 

Suppose that Tif is invert ible in K(h), then we define the formal multiplication operators 

Mf(h) := (Hl)- l H^ A . 
The following result characterizes the cases where K[x] = B © Ja: 

Theorem 4.2. Let B = {x' 31 , . . . , x' 3 ' } be a set of monomials of degree < d, connected to 1 and A be a 
linear form in (B ■ B + )* d . Let A(h) be the linear form of {B ■ B + )* defined by A(h)(x Q ) = A(x Q ) if \a\ < d 
and h a £ K otherwise. Then, A(h) admits an extension A £ R* such that H A is of rank r with B a basis of 
A A *ff 

(8) M?(h)oMf(h)-Mf(h)oM?(h) = (l<i<j<n) 

and det(7i A )(h) ^ 0. Moreover, such a A is unique. 

Proof. If there exists A £ R* which extends A(h), with H^ of rank r then the tables of multiplications by 
the variables Xj are M, = (Ha)~ 1 T~(-x ''*a (proposition 13. 9\i and they commute. 

Conversely suppose that these matrices commute. Then by [43(, we have K[x] = (B) © (K), where K is 
the vector space generated by the border relations a^m — Mi{m) for m € B and i = 1, . . . , n. Let ttb be the 
projection of R on (B) along (K). 

We define A e R* as follows: Vp e R,A(p) = A(p(M)(l)) where is the operator obtained by 

substitution of the variables Xi by the commuting operators Aii. Notice that p(Ai) is also the operator of 
multiplication by p modulo (K). 

By construction, (K) C keriJ A and B is a generating set of A A - 

Let us prove by induction on the degree of b E B that for all b' G B, we have A(bb') = A(b(M) (&')). 
The property is true for 6=1. As B is connected to 1, if b ^ 1, then b — Xi b" for some variable Xi and 
some element b" E B of degree smaller than 6. By construction of the operators Mj, we have A{xib" b') = 
A(b"Mi(b')). By induction hypothesis, we deduce that A(bb') = A{b"(M) o M t (b')) = A(b(M){b')). As 
b 1 = b'(M)(l) for all b 1 £ B (the multiplication of 1 by b is represented by b £ (B) modulo (K)), we deduce 
that 

A(bb') = A(b"(M) o Mi(b')) = A(b(M) o 6'(M)(1)) = A{{bb'){M){l)) = A{bb'). 

This shows that A = A on B ■ B. As det(Hf) 7^ 0, we deduce that -B is a basis of A A and that i? A is of rank 
r. 

If there exists another A' € R* which extends A(h) £ (B ■ B + ) with ranki?A/ = r, by proposition 13.51 
kcriJA' is generated by kerH A ,' B and thus coincides with kerH A . As A' coincides with A on B, the two 
elements of R* must be equal. This ends the proof of the theorem. □ 

The degree of these commutation relations is at most 2 in the coefficients of the multiplications matrices 
A4i. A direct computation yields the following, for m £ B: 

• J£xi,m£ B,Xj m £ B then (Mf o Mf - Mf ° Mf){m) = in K(h). 

• If Xim £ B, Xj m E' B then {Mf o Mf - Mf o Mf )(m) is of degree 1 in the coefficients of Mi,Mj. 

• If Xim £ B, Xj m £ B then (Mf o Mf — Mf o Mf)(m) is of degree 2 in the coefficients of Mi,Mj. 
We are going to give an equivalent characterization of the extension property, based on rank conditions. 
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Theorem 4.3. Let B = {x ft , . . . ,x A } be a set of monomials of degree < d, connected to 1. Then, the 
linear form f* G S*i admits an extension A £ JJ* such that H\ is of rank r with B a basis of Aa iff there 
exists an h such that all (r + 1) x (r + 1) minors ofTt B+ Qn) vanish and det(7i^)(h) 7^ 0. 

Proof. Clearly, if there exists A £ R* which extends /* <E with Ha of rank r, then all (r + 1) X (r + 1) 
minors of Ti B+ (h) vanish. 

Conversely, if 7i A J+ (h) and H^h) are of rank r, by [40, Theorem 1.4] there exists a unique AeE* such 
that Ha is of rank r, and which coincides with A on (B + ■ B + ). □ 

Proposition 4.4. Let B = {x^ 1 , . . . ,x^ r } be a set of monomials of degree < d, connected to 1. Then, the 
linear form f* € S 1 ^ admits an extension A £ R* such that Ha is of rank r with B a basis of Aa iff 

0) < = G 



G* J 



wrai/i H = Hf and 



(10) G = DH W, J = W* H W. 

/or some matrix W £ K. Bx9B . 



Proof. According to theorem 14.31 /* € S*[ admits a (unique) extension A <G R* such that Ha is of rank r 
with £? a basis of ,4a, iff H B+ is of rank r. Let us decompose H B+ as §§§ with OH = DH^. 



3+ 

If we have G = H W, J = W* H W, then 



H HW 

v W*H W'HW 

is clearly of rank < rank H . 

Conversely, suppose that H A J+ = rankH. This implies that the image of G is in the image of H. Thus, 
there exists W € K BxdB such that G = HW. Without loss of generality, we can assume that the r first 
columns of H (r — rankH) are linearly independent. Assume that we choose W such that the i th column 
of G is the linear combination of the r first columns with coefficients corresponding to the i column W; 
of W. As rank = r the same relation holds for the whole column of this matrix. Thus we have 
J = G'W = W'HW. □ 

Notice that if H is invertible, W is uniquely determined. In this case, we easily check that ker H£ + = 
W ' 



This leads to the following system in the variables h and the coefficients w of matrix W. It characterizes 
the linear forms /* € that admit an extension A 6 R* such that is of rank r with B a basis of Aa- 

(11) wf 9B (h)-7if(h)W(w) -0, ^ s ' as (h)-W 4 (w)Wf(h)W(w) =0 

with det(Wf (h)) ^ 0. 



The matrix H. B is a quasi-Hankel matrix 44 1. whose structure is imposed by equality (linear) constraints 



on its entries. If H is known (ic. B x B C Rd, the number of independent parameters in H^ B (h) or in 
W is the number of monomials in B x dB — Rd- By Proposition 14. 4\ the rank condition is equivalent to the 
quadratic relations J — W'H* W = in these unknowns. 

If H is not completely known, the number of parameters in H is the number of monomials in B x B — Rd- 
The number of independent parameters in ^^'^^(h) or in W is then B x dB — Rd- 

The system (|11[) is composed of linear equations deduced from quasi-Hankel structure, quadratic relations 
for the entries in B x dB and cubic relations for the entries in B x dB in the unknown parameters h and w. 

We are going to use explicitly these characterizations in the new algorithm we propose for minimal tensor 
decomposition. 
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5. Symmetric tensor decomposition algorithm 



The algorithm that we will present for decomposing a symmetric tensor as sum of rank 1 symmetric 



tensors generalizes the algorithm of Sylvester [52|, devised for dimension 2 tensors, see also 

Consider the homogeneous polynomial /(x) in (J3]) that we want to decompose. We may assume without 
loss of generality, that for at least one variable, say xq, all its coefficients in the decomposition are non zero, 
i.e. ki ; o 7^ 0, for 1 < i < r. We dehomogenize / with respect to this variable and we denote this polynomial 
by f a '■— /(I: x ii ■ ■ ■ i x n)- We want to decompose the polynomial / a (x) g Rd as a sum of powers of linear 
forms, i.e. 

r r 

/(x) = A « C 1 + hi x l + ■■■ + h,nx„) d = k 4 (x) d 

i=l i=l 

Equivalently, we want to decompose its corresponding dual element /* £ Rd* as a linear combination of 
evaluations over the distinct points :— (fc^i, • • • , ki <n ): 



i=l 

(we refer the reader to the end of Section 12. 3|) . 

Assume that we know the value of r. As we have seen previously, knowing the value of A on polynomials 
of degree high enough, allows us to compute the table of multiplications modulo the kernel of Ha- By 
Theorem l3.101 solving the generalized eigenvector problem (H^+a — A Ha)v = O, we will recover the points 
of evaluation k^. By solving a linear system, we will then deduce the value of Aj, . . . , \ r . Thus, the goal of 
the following algorithm is to extend /* on a large enough set of polynomials, in order to be able to run this 
eigenvalue computation. 



Algorithm 5.1: Symmetric tensor decomposition 
Input: A homogeneous polynomial f(xo, x\, . . . , x n ) of degree d. 
Output: A decomposition of / as / = Y%=i A « kj(x) d with r minimal. 

- Compute the coefficients of /*: c a — a a , for \a\ < d; 
-r:=l; 

Repeat 

(1) Compute a set B of monomials of degree < d connected to 1 with \B\ = r; 

(2) Find parameters h s.t. det(Hf) ^ and the operators Mi = H^. A (IH A J ) _1 commute. 

(3) If there is no solution, restart the loop with r := r + 1. 

(4) Else compute the n x r eigenvalues Q t j and the eigenvectors Vj s.t. MiVj — djVj, 
i = 1, ■ ■ ■ ,n, j = 1, . . . ,r. 

until the eigenvalues are simple. 

- Solve the linear system in [vj)j=i,...,k' = Y^j=i U j^-Cj wn ere Q € K™ are the eigenvectors found 
in step 4. 



The critical part in this algorithm is the completion of step 2. Instead of the commutation relations, one 
can use the result of Proposition 14.41 



5.1. First Example. The example that follows will make the steps of the algorithm clearer. 

(1) Convert the symmetric tensor to the corresponding homogeneous polynomial. 

li 



Assume that a tensor of dimension 3 and order 5, or equivalently a 3-way array of dimension 5, corresponds 
to the following homogeneous polynomial 

/ = -1549440 x aXl x 2 3 + 2417040 x x 1 2 x 2 2 + 166320 x 2 x 1 x 2 2 - 829440 x x 1 3 x 2 - 5760 x 3 x 1 x 2 - 
222480 a^i 2 ^ + 38 x 5 - 497664 xi 5 - 1107804 x 2 5 - 120x 4 a;i + 180 x 4 x 2 + 12720 x 3 X! 2 + 
8220 aioW - 34560 x 2 xi 3 - 59160 x 2 x 2 3 + 831840 x oXl 4 + 442590 x x 2 4 - 5591520 x^x 2 + 
7983360 xx 3 x 2 2 - 9653040 xi 2 x 2 3 + 5116680 x lX2 A . 

The minimum decomposition of the polynomial as a sum of powers of linear forms is 

(x + 2x 1 +3x 2 ) 5 + Oo - 2xi + 3x 2 ) 5 + ~(x a - 12 xi -3x 2 ) 5 + -(x + 12 x 1 - 13 x 2 ) 5 , 

3 5 

that is, the corresponding tensor is of rank 4. 

(2) Compute the actual number of variables needed. 

For algorithms computing the so-called number of essential variables, the reader may refer to the 
work of Oldenburger [45| or Carlini Q. 



In our example the number of essential variable is 3, so we have nothing to do. 



(3) Compute the matrix of the quotient algebra. 

We form a x ) matrix, the rows and the columns of which correspond to the 

coefficients of the polynomial in the dual base. The map for this is 



"3a 31 —3n 



-30 31 



''3031 —In 



\]0, 



where ad di ... d n is the coefficient of the monomial x 3 ° ■ ■ ■ x ] ™ in /. Recall that, since the polynomial 
is homogeneous, Y^i=i 3i = d- 

This matrix is called quasi-Hankel [3| or Catalecticant [3lj |. 



Part of the corresponding matrix follows. The whole matrix is 21 x 21. We show only the 10 x 10 principal 
minor. 





1 


XI 


X2 


T 2 

x 1 


X1X2 


-r 2 

x 2 


x 1 


x\x2 


xix\ 


r 3 


1 


38 


— 24 


36 


1272 


-288 


822 


-3456 


-7416 


5544 


-5916 


Xi 


-24 


1272 


-288 


-3456 


-7416 


5544 


166368 


-41472 


80568 


-77472 




36 


-288 


822 


-7416 


5544 


-5916 


-41472 


80568 


-77472 


88518 


A 


1272 


-3456 


-7416 


166368 


-41472 


80568 


-497664 


-1118304 


798336 


-965304 




-288 


-7416 


5544 


-41472 


80568 


-77472 


-1118304 


798336 


-965304 


1023336 


X 2 


822 


5544 


-5916 


80568 


-77472 


88518 


798336 


-965304 


1023336 


-1107804 


4 


-3456 


166368 


-41472 


-497664 


-1118304 


798336 


^6,0,0 


^5,1,0 


hi,2fi 


^3,3,0 


x\x 2 


-7416 


-41472 


80568 


-1118304 


798336 


-965304 


^5,1,0 


^4,2,0 


^3,3,0 


^2,4,0 




5544 


80568 


-77472 


798336 


-965304 


1023336 


^■4,2,0 


^3,3,0 


^■2,4,0 


^1,5,0 


x 2 


-5916 


-77472 


88518 


-965304 


1023336 


-1107804 


^■3,3,0 


^2,4,0 


^1,5,0 


^0,6,0 



Notice that we do not know the elements in some positions of the matrix. In general we do not know the 
elements that correspond to monomials with (total) degree higher than 5. 



(4) Extract a principal minor of full rank. 

We should re-arrange the rows and the columns of the matrix so that there is a principal minor 
of full rank, R. We call this minor Ao. In order to do that we try to put the matrix in row echelon 
form, using elementary row and column operations. 
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In our example the 4x4 principal minor is of full rank, so there is no need for re-arranging the matrix. The 
matrix Aq is 



A = 



Notice that the columns of the matrix correspond to the monomials {1, x\, X2, x\ }. 



38 


-24 


3G 


1272 


-24 


1272 


-288 


-3456 


3G 


-288 


822 


-7416 


1272 


-3456 


-7416 


166368 



(5) We compute the "shifted" matrix Ai = X1A0. 

The columns of Ao correspond to set of some monomials, say {x a } where a C W 1 . The columns 
of Ai correspond to the set of monomials {xi x a }. 



The shifted matrix Ai is 



Ai 



-24 


1272 


-288 


-3456 


1272 


-3456 


-7416 


166368 


-288 


-7416 


5544 


-41472 


-3456 


166368 


-41472 


-497664 



Notice that the columns correspond to the monomials {xi, x\ , Xxx%, xf}, which are just the corresponding 
monomials of the columns of Aq, i.e. {1, x\, X2, xf}, multiplied by x\. 



We assume for the moment that all the elements of the matrices Ao and Ai are known. If this 
is not the case, then we can compute the unknown entries of the matrix, using either necessary and 
sufficient conditions of the quotient algebra, e.g. it holds that M Xi M Xj — M Xj M Xi = <D_|43( for any 
i, j 6 {1, . . . ,n}. There are other algorithms to extend a moment matrix, e.g. 3, 3^, 30(] - 
(6) We solve the equation (Ai — XA )X = 0. 

We solve the generalized eigenvalue/eigenvector problem using one of the well-known techniques 
[28l ]. We normalize the elements of the eigenvectors so that the first element is 1, and we read the 
solutions from the coordinates of the (normalized) eigenvectors. 



The normalized eigenvectors of the generalized eigenvalue problem are 



1 




1 


-12 




12 


-3 




-13 


144 




144 



1 

-2 
3 
4 



The coordinates of the eigenvectors correspond to the elements {1, x\, X2, x\ }. Thus, we can recover the 
coefficients of X\ and X2 in the decomposition from coordinates of the eigenvectors. 

Recall that the coefficients of xq are considered to be one. Thus, The polynomial admits a decomposition 

/ = £i(x - 12xi - 3x 2 ) 5 + l 2 (x + 12xi - 13x 2 ) 5 + 40o - 2a;i + 3x 2 ) 5 + 40o + 2x t + 3x 2 ) 5 

It remains to compute £i's. We can do this easily by solving an over-determined linear system, which we 
know that always has a solution, since the decomposition exists. Doing that, we deduce that l\ = 3, 

h = 15, h = 15 and £ 4 = 5. 



5.2. Second Example. One of the assumptions that the previous example fulfills is that all the entries of 
the matrices needed for the computations are known. However, this is not always the case as the following 
example shows. 

(1) Convert the symmetric tensor to the corresponding homogeneous polynomial. 
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Consider a tensor of dimension 3 and order 4, that corresponds to the following homogeneous polynomial 

/ = 79 xqx\ + 56 XqX2 + 49 x\x\ +4 xqX\x\ + 57 XqX± , 

the rank of which is 6. 

(2) Compute the actual number of variables needed. 

In our example the number of essential variables is 3, so we have nothing to do. 

(3) Compute the matrix of the quotient algebra. 

The matrix is 15 x 15. 





1 


Xl 


X2 


x\ 


XiX 2 


.('0 


xl 


icf £2 




x 2 


A 


xfx 2 


2 2 




x 2 


1 





b'l 
4 











28 

? 
3 


7« 
3 





1 











4U 

6 








xi 


57 

4 








70 
4 








f) 


ii. 





/l500 


ft-410 


/l320 


^230 


frl40 










3 





1 








.1.') 

6 





f) 


ft-410 


/l320 


^230 


^140 


^050 


4 





70 

3 











■10 
<■> 


^500 


fr-410 


^320 


^230 


heoo 


^510 


/l420 


/l330 


^240 


X1X2 








1 

3 





10 
(i 





/l410 


/i320 


ft-230 


ft<140 




/l420 


^330 


/l240 


hl50 


X 2 


28 
3 


l 

3 





■in 

6 








^320 


^230 


^140 


^050 


^420 


^330 


^240 


^150 


^060 


4 


79 

4 








/l500 


/1410 


^320 


^600 


^■510 


/l420 


^330 


hjQQ 


h&io 


/1520 


^430 


/l340 










49 
6 


^410 


^320 


^230 




^420 


^330 


^240 




^520 


/l430 


^340 


/l250 




1 

3 


■40 
6 





^320 


^230 


^140 


h-420 


^330 


^240 


^150 




^430 


^340 


^250 




X x\ 











^230 


hl40 


^050 


^330 


^240 


hiso 


^060 


^430 


^340 


/l250 


^160 


hojQ 





^500 


^410 


^600 


/l510 


^420 


hjQQ 


^610 




^430 




^710 


/l620 


^530 


fr-440 


x\x2 





^410 


/1320 


^510 


/l420 


^330 


hQlQ 


^520 


/l430 


^340 


^710 


^620 


^530 


/l440 


^350 


2 2 
x l x 2 


49 
6 


^320 


^230 


/l420 


^330 


/l240 


^520 


^430 


^340 


^250 


^620 


^530 


/l440 


^350 


/l260 


X X 3 





^■230 


^140 


^330 


^240 


^150 


^430 


^340 


^250 


^160 


^530 


^440 


^350 


^260 


^170 


x 2 





^140 


^050 


^240 


^150 


^060 


^340 


^250 


^160 


^070 


/I44O 


^350 


^260 


^170 


^080 



(4) Extract a principal minor of full rank. 



In our example the 6x6 principal minor is of full rank. The matrix Ao is 

28 

? 
3 

49 
6 






A = 






57 
4 








57 
4 








79 
4 








28 
3 








79 

4 














1 

3 





28 


1 





49 


- 3 


3 


fi 






_L 

.3 



49 
6 





The columns (and the rows) of the matrix correspond to the monomials {1, x\, x%, x\ 1 x\X2 : x%}- 



(5) We compute the "shifted" matrix Ai = xiAq. 



The shifted matrix Ai is 



" 57 

4 






79 
4 






79 

4 








1 

I 
6 








1 

.3 





49 
6 





79 
4 








^500 


ft-410 


^320 








49 
6 


ft-410 


^320 


ft-230 


1 

- 3 


49 






^320 


^230 


h 140 



Ai 



The columns of the matrix correspond to the monomials {x%, x\, X1X2, xf, xfx2, X1X2} which are the mono- 
mials that correspond to the columns of Ao, i.e. {1, xi, X2, xf, X1X2, x^}, multiplied by x\. 
Since not all the entries of Ai are known, we need to compute them in order to proceed. 



Consider the following method to extend the matrix of a quotient algebra. In the quotient algebra 
it holds that IM^ IM^ — DVI^ DVI CCi = O [43( for any i, j E {1, . . . ,n}, i.e. the matrices of multiplications 
commute (cf. Section 2]). 

From Proposition 13 . 91 we know that A; = DVI^,. Ao, and hence DVl^ = A^Aq" 1 , for 1 < i < n. 
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We form all the possible matrix equations, M Xi M Xj — M Xj M Xi — <D, there are Q), and we equate 
their elements to zero. Since the dimension of the matrices is r x r, this leads to at most uV 2 ) or 
0(n 2 r 2 ) equations. Note that the equations are, at most of total degree 2. 



In our example the matrix A2 is 



A 2 = 









2S 

1 
3 





1 














& 
6 





28 
3 


1 

3 





49 
6 














49 
6 


ft-410 


^320 


^230 


1 

3 


49 
6 





^320 


^230 


h 140 











^230 


^140 


^050 



Since we have only two variables, there is only one matrix equation, 

M Xi M Xj - M Xj M Xi = AiA " 1 A 2 Aq 1 - A 2 A 1 A 1 A^ 1 = O. 

Many of the resuling equations are trivial. After disgarding them, we have 6 unknonws 

{/1500, ^410, h 32Q , h 23Q , hu , h 05Q } and 15 equations. 
A solution of the system is the following 

{/1500 = 1, h iw = 2, h 32 o = 3, h 230 = 1.5060, /1140 = 4.960, /i 50 = 0.056}. 
We subsitute these values to Ai and we continue the algorithm as in the previous example. 

Other algorithms to extend a moment matrix, e.g. (lil l38l. I39I] . the so called flat estensions, are 
applicable when the Ao is positive definite. 
(6) We solve the equation (Ai — \A )X = 0. 



The normalized eigenvectors of the generalized eigenvalue problem are 



1 








1 






1.0 


-0.830 


f 1.593 i 




-0.830 


- 1.593 i 




1.142 


-0.326- 


- 0.0501 i 




-0.326 


+ 0.050 i 




0.836 


-1.849 


- 2.645 i 




-1.849 


+ 2.645 i 




1.305 


0.350- 


0.478 i 




0.350- 


1- 0.478 z 




0.955 


0.103 + 


0.0327 i 




0.103- 


- 0.032 i 




0.699 


10.956 " 
-0.713 

0.914 
-0.682 

0.509 




1 

-0.838 4 


- 0.130 i 




1 

-0.838- 


- 0.130 i 




0.060 + 


0.736 i 




0.060- 


0.736 i 




0.686 - 


0.219t 


1 


0.686 + 


0.219* 




-0.147- 


- 0.610 i 




-0.147 4 


- 0.610 % 




—0.539 + 


- 0.089 i 




-0.539- 


- 0.089 i 



The coordinates of the eigenvectors correspond to the elements {1, x±, x%, xl,xix 2 , x?,} and we can recover 
the coefficients of x\ and x 2 in the decomposition. 

After, solving the over-constrained linear system for the coefficients of the linear forms we deduce the 
decomposition 



(0.517 + 0.044 i) (x - (0.830 - 1.593 i)x x 
-(0.517 - 0.044 i) (x Q - (0.830 + 1.593 i)x x 

+2.958 (sco 4 
+4.583 (x 4 



(0.326 + 0.050 i)x 2 ) 
(0.326- 0.050 i)x 2 ) A 
0.836x 2 ) 4 
0.713x 2 ) 4 



(1.142)xi 

(0.956)35! 



-(4.288 + 1.119 i) (x a - (0.838 - 0.130 i)x x + (0.060 + 0.736 i)x 2 y 
-(4.288- 1.119 i) (.T - (0.838 + 0.130 i)x x + (0.060 - 0.736 i)x 2 ) A 
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6. Conclusions and future work 



We propose an algorithm that computes symmetric tensor decompositions, extending Sylvester's algo- 
rithm. The main ingredients are i) reformulate the problem in a dual space, ii) exploit the properties of 
multivariate Hankel operators and Gorenstein algebra, iii) devise an effective method to solve, when nec- 
essary, the truncated Hankel problem, iv) deduce the decomposition by solving a generalized eigenvalue 
problem. 

There are several open questions that we are currently working on. What is the (arithmetic and Boolean) 
complexity of the algorithm? If we do not know all the the elements of the tensor, can we still compute a 
decomposition? 
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Appendix A. Ternary cubics 



As an application, we present the decomposition of all the types of ternary cubics. The decomposition 
allows us to classify, up to projective transformations of the variables, homogeneous polynomials of degree 
three in three variables, for instance with the help of the algorithm described in [13l ] . For another algorithm 
for decomposing ternary cubics, based on the method of moving frames and on triangular decompositions of 



algebraic varieties, we refer the reader to 34|. Two polynomial are equivalent in this classicifation if there 
exists a varaibles invertible trnasfmation which maps one polynomial to the other. 

The classification algorithm goes as follows. Given a ternary cubic, we compute its decomposition as a 
sum of powers of linear forms. We have the following cases: 

• If the rank is one then the polynomial is a 3 rd power of a linear form, that is, it is equivalent to Xq. 
If the rank is 2, then the polynomial is equivalent to Xq + x± and is in the orbit of xqXi(xq + x x ). In 
fact, the decomposition of the latter polynomial is 

1628000 r-\ f f 125 17 r-\ ( 22 27 A 

-260712 iV3 iV3 ) x + 1 iV3 x x 

9 Ml 16492 16492 \ 4123 8246 J 



„™„ „ 1628000 A ( ( 125 17 A / 22 27 n \ 

-260712 + —j- l VS + + -4123 " 8246 ^ ^ * 



3 



» If the rank is 3, then the polynomial is either in the orbit of XqX X or in the orbit of Xq + x\ + x\- To 
identify the orbit, it suffice to check if the polynomial is square-free or not (that is, check whether 
the gcd between the polynomial and one of its derivatives is 1). If it is not square- free then it is in 
the orbit of x 2 ] x x . Otherwise it is in the orbit of Xq + x\ + x\. 
The decomposition of x\x x is 

-0.15563 - 0.54280 i((-0.95437 - 0.08483 i)x + (-0.00212 + 0.28631 i) Xl ) 3 
-0.15723 + 0.54841 z((— 0.95111 + 0.09194i)a;o + (-0.00222 - 0.29484 i) Xl ) 3 

-0.04320((-0.49451)a;o + (-0.86917)a;i) 3 . 

» If the rank is 4, then our polynomial is generic. As an example, consider the polynomial 150 xq 2 X2 + 
X\ 2 X2 + X2 3 — 12 xq 3 ; a decomposition of which is 

0.53629(+0.34496a;o + 0.71403xi + 0.60923x 2 ) 3 
-195.64389(-0.99227x + 0.00286cci - 0.12403:C2) 3 
+211.45588(-0.99282x Q + 0.00311a;i + 0.11962x 2 ) 3 
+0.52875(-0.34600x - 0.71671a;! + 0.60549ir 2 ) 3 . 

• If the rank is 5, then the polynomial is of maximal rank and it is in the orbit of Xn^i ~\~ xqx 2 , a 
decomposition of which, is 

+0.28100(+0.06322x - 0.99748xi + 0.03224ir 2 ) 3 
+0.97839(+0.14391a;o + 0.50613xi + 0.85036a; 2 ) 3 
+0.44877(+0.73493a;o + 0.56369xi - 0.37702a; 2 ) 3 
f (-0.97396 - 0.94535 i)(0.45304a; + (-0.60752 + 0.14316 i)x x + (-0.52915 + 0.35382 i)x 2 f 
-(-0.97396 + 0.94535 i)(0.45304x + (-0.60752 + 0.14316 i)x x + (-0.52915 - 0.35382 i)x 2 f ■ 



Appendix B. An example of extreme rank 

In this section we present in detail the decomposition of a ternary cubic of maximal rank, that is 5. 
Consider the polynomial 

2 2 
XqX X — |— XqX^. 
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The matrix of the quotient algebra is 
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/ll 3 o 
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^1,4,0 


1 

3 








^2,2,0 


^1,3,0 


^0,4,0 


^3,2,0 


^2,3,0 


^1,4,0 


^0,5,0 





^4,0,0 


^3,1,0 


/l5,0,0 
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and the matrices Aq, Ai and A2 are 
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If we form the matrix equation 

M Xi M Xj - M Xj M Xi = AiA ~ 1 A 2 Aq 1 - A 2 A " 1 AiA ( 7 1 = O. 
then we have a system of 8 equations in 8 unknowns. The unknowns are 

{^5,0, 0j ^4,1,0i ^4,0, 0j ^3,1,0) h-2,2,0, ^1,3,0; ^3,2,0; ^2,3,o} • 

It turns out that the system is not zero dimensional, and that we can choose (randomly) the values of five 
of them, i.e. {^1,3,0 = 3, /i3,i,o = 1^2,2,0 = 2, /i^^o = 4,^0,0 = 5}. Working as in the other examples we 
end up with the decomposition 

+0.000071(a;o - 15.778a;i + 0.510a: 2 ) 3 
+0.002916(a; + 3.517zi + 5.909x 2 ) 3 
+0.178137(a;o + 0.767a;! - 0.513x 2 ) 3 
(-0.09056 - 0.0879 i)(x + (-1.341 + 0.316 i)xi + (-1.168 + 0.781 i)x 2 f 
(-0.09056 + 0.0879 i)(x + (-1.341 + 0.316 i)x! + (-1.168 - 0.78H)a; 2 ) 3 . 
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